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We present fixed domain asymptotic results that establish con- 
sistent estimates of the variance and scale parameters for a Gaussian 
random field with a geometric anisotropic Matern autocovariance in 
dimension d > 4. When d < 4 this is impossible due to the mutual 
absolute continuity of Matern Gaussian random fields with different 
scale and variance (see Zhang [33]). Informally, when d > 4, we show 
that one can estimate the coefficient on the principle irregular term 
accurately enough to get a consistent estimate of the coefficient on 
the second irregular term. These two coefficients can then be used to 
separate the scale and variance. We extend our results to the general 
problem of estimating a variance and geometric anisotropy for more 
general autocovariance functions. Our results illustrate the interac- 
tion between the accuracy of estimation, the smoothness of the ran- 
dom field, the dimension of the observation space, and the number of 
increments used for estimation. As a corollary, our results establish 
the orthogonality of Matern Gaussian random fields with different 
parameters when d > 4. The case d = 4 is still open. 

1. Introduction. A common situation in spatial statistics is when one has observations 
on a single realization of a random field y at a large number of spatial points ti,t2, ■ ■ ■ within 
some bounded region 17 C M'^. One is then is faced with the problem of predicting some 
quantity that depends on Y at unobserved points in J7. For example, one may want to 
predict Y(t)dt or the derivative Y'{tQ) where to is an unobserved point in Q. A common 
technique is to first estimate the covariance structure of Y, then predict using the estimated 
covariance. Typically, fully nonparametric estimation of the covariance is difficult since the 
observations are from one realization of the random field. In this case, it is common to 
consider a class of covariance structures indexed by a finite number of parameters which 
are then estimated from the observations (see [12] or [9] for an introduction to spatial 
statistical techniques). 

Two common parameters found in many covariance models are an overall scale a and 
an overall variance a'^. The simplest example of this model stipulates that the random field 
y is a scale and amplitude chance by an unknown a and o" of a known random field Z. In 
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particular, for a spatial domain 0, C M^, Y is modeled as 

(1) {Y{t):t£n} = {aZ{at):t£n} 

D 

where = denotes equality of the finite dimensional distributions. In this case, a is an overall 
amplitude (in units of Y) and a is an overall spatial scale (in units of t). For a nice discussion 
of the roll of a and a in the Matern autocovariance see Section 6.5 in [28'. 

A fundamental question is whether or not a and a are consistently estimable when the 
number of the observations in Q grows to infinity. Indeed, the answer is no in general. 
This is immediate from the existence of self similar random fields that satisfy {Z{at) : t G 

rj} = {a'^Z{t) : t G $7} for any a > where u is a fixed constant. For these self-similar 
processes, any two pairs ((Ti,ai) and (o"2,a2) that satisfy cr^af*^ = (j\o32^ give the same 
model in ([T]). This problem can also be present when Z is not self similar. For example, 
suppose Z is an isotropic Ornstein-Uhlenbeck process in dimension d < 3 (see Figure [T]) . 
In this case, if o\a\ = 02a2 (i.e. v = 1/2) the two models for Y yield mutually absolutely 
continuous measures (when d = 1 see [19j, [32l, when d = 2,3 see [33], [28]) and therefore 
are impossible to discern with probability one when observing one realization of Y . We shall 
see, however, that in some cases it is possible to consistently estimate a and a. Moreover, it 
will depend on dimension: typically the larger the dimension the more information there is 
to separate a from a. Before we continue, we mention the work of Stein (see [25], [26]) which 
establishes that even if two models are mutually absolutely continuous, using the wrong 
model to make predictions may still yield asymptotically optimal estimates. In fact, this 
phenomenon can also occur for orthogonal measures when restricting to predictors that are 
linear combinations of the observations (see [27] ) . 

To understand the condition a\a^ = (j\o32^ one can look at what is called the principle 
irregular term of the autocovariance function (see [IH])- Suppose, for exposition, that there 
exist constants (52 > (5i > such that the covariance structure of Z satisfies 

(2) cov(Z(t + Ai),Z(t)) ?s ci|/i|^^ +C2|/i|'^2 +p(|/i|), as|/i|^0 

where p is an even polynomial and both b\^bi are not even integers. This model is not 
as restrictive as it seems and includes the Ornstein-Uhlenbeck process, the exponential 
autocovariance function e"'*^*' ^ and the Matern autocovariance function (see below). The 
term ci|/i|^^ is often referred to as the principle irregular term and is instrumental in 
determining the smoothness of Z. The second term, C2|/i|'^^, is less influential but can have 
an observable effect depending on dimension and the magnitude of b2 — b\ - Now, if we model 
y by ([TJ and ^ we get 

(3) cov(y(t + /i),y(t)) wciCT^a^il/il^i +C2cj2a''2|/i|^2 +^(|/i|), as ^ 0. 

Therefore for two pairs of parameters (fTi,ai) and (cr2,a2), the condition a\oLY = d^OL^ 
ensures that the covariance models for Y have the same principle irregular term. This 
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Z{2t) V2Z{t) 

Fig 1: Independent simulations of Z{2t) and \/2Z(t), observed on a dense grid in [0,10], 
where Z is the Ornstein-Uhlenbeck process with covariance structure cov (Z (s), Z(t)) = 
g-|s-t|_ -|^^ 2 and 3 dimensions these two processes (isotropicahy extended) are mutually 
absolutely continuous and therefore cannot be consistently distinguished under fixed domain 
asymptotics. Our results establish that when the dimension is greater than 4 one can 
distinguish the two with probability one under fixed domain asymptotics. 



explains the importance of the quantity a'^a^^. In addition, if one can estimate both coeffi- 
cients ciCT^a^i and C20'^C(^^ then it is possible to get separate estimates of a and a. In what 
follows we develop consistent estimators of these two coefficients which allow consistent 
estimation of a and a. 

The majority of this paper focuses on the case when Z is a mean zero, isotropic Gaussian 
random field which has a Matern autocovariance. The reasons are twofold. First, the Matern 
autocovariance has been used extensively in spatial statistics so that results on the Matern 
autocovariance are of intrinsic interest alone. The second reason is that once one establishes 
the results for the Matern it is relatively easy to see how to extend to other covariance 
functions. In Section [3j we give two examples that illustrate these extensions. Our Matern 
assumption stipulates the existence of a known > such that 

(^) 

for all s,t G C M'^ where | • | denotes Euclidean distance and %^ is the modified Bessel 
function of the second kind of order > (see [1]). The parameter controls the mean 
square smoothness of the process: larger v corresponds to smoother Z. The flexibility pro- 
vided by the smoothness parameter ly along with the fact that it is positive definite in any 
dimension leads to its widespread use in spatial statistics. 

In what follows we extend the basic model ([T]) to the case when there is an unknown 
invertible matrix M with determinant 1 (this class of matrices we denote by SL{d,M)) so 
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that 

(5) {Y{t) :t£n} = {aZ{aMt) : t G 17}. 

The matrix M is called a geometric anisotropy and is used to model a directional sheer of 
Z. The assumption that det M = 1 removes identifiability problems with the overall scale 
parameter a. In Section |2] we construct estimates of cr^a^'^, M and a. We show that the 
estimates of a'^a'^'^ and M are strongly consistent in any dimension and the estimate of a 
is strongly consistent when d > 4. 

There is a fair amount of literature on estimating a'^a'^'^ for the Matern autocovariance. 
In 1991, Ying [32 established strong consistency and the asymptotic distribution of the 
maximum likelihood estimate of a'^a'^'^ for the Ornstein-Uhlenbeck process when d = 1 
(which has a Matern autocovariance for v = 1/2). In 2004, Zhang [33j established that the 
maximum likelihood estimate of cr^a^'^ (obtained by fixing a and u) is strongly consistent 
when d < 3. In related work, Loh [23] shows that maximum likelihood estimates of scale 
and variance parameters in a non-isotropic multiplicative Matern model are consistent when 

= 3/2 (similar results for the Gaussian autocovariance model can be found in [24!). In 
Section 6.7 of [28 , Stein derives asymptotic properties of the maximum likelihood estimates 
of a, a and for a periodic version of the Matern random field. For this periodic random 
field all the parameters are consistently estimable when d > 4. Our results confirm these 
findings for a and a with the non-periodic Matern when d > 4. The case d = 4 is still open. 

Recent work by Kaufman et al. ^ and Du et al. [13] studies maximum likelihood estimates 
of a'^a'^'^ using a tapered Matern autocovariance when d < 3. The advantage gained by 
tapering is a reduction of the computational load for computing the likelihood and for 
computing kriging estimates. We will see that our estimates of the same quantity, fi^a^'^, 
yield strongly consistent estimates in any dimension which are "root n" consistent and are 
easily computed with no maximization required. However, our estimates depend on the grid 
format of the observations whereas the maximum likelihood estimates are not confined to 
such restrictions. We also expect some loss of efficiency in our estimates as compared to 
the MLE. We hope that there is potential to combine the two estimation methods using a 
one-Newton-step tapered likelihood adjustment to the increment based estimate. Since our 
results can be easily extended, by a Lindeberg-Feller argument, to obtain the asymptotic 
normality of a'^a'^'^ when d < 3, we believe this has the potential to mitigate any loss of 
efficiency and reduce the computational load for the maximum likelihood estimate. 

Finally we mention the long tradition of using squared increments to estimate properties 
of random fields, beginning with the quadratic variation theorem of Levy in 1940 ([22]). For 
example, increments have been used in |20j and [i6j for identification of a local fractional 
index and in [11] to identify the singularity function of a fractional process. In [4j they 
are used to estimate a deformation of an isotropic random field. For more results on the 
convergence of quadratic variations see, [5], [IS], [H], [M], [7], [30], [2], [6], [E], [lO], [20]. 
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2. The geometric anisotropic Matern class. In this section we construct estimates 
of a^o?" ^ M and a using increments of Y observed on a dense grid within £l. Using fixed 
domain asymptotics, we establish consistency of our estimates under assumptions Q and 
([5]) and provide bounds on the rate of variance decay as it depends on the number of 
increments used, the dimension of and the smoothness of Y measured by v. These results 
will hold in any dimension. However, when the dimension is large enough {d > 4), the 
second term in ([s]) is influential enough so that a can be estimated consistently. 

If the observation region is an open subset of M*^ and the random field Y is modeled by 
Q and ^ , then Y is said to be a d-dimensional geometric anisotropic Matern random field 
with parameters (cr, a, v, M). In this case, the covariance structure of Y is cov(y(s), Y(t)) = 
K{\Ms — Mt|), where K is defined as 

(6) m ^ ^^Ml.x.{at) 

for t > and K{0) = limtiQ K{t) = . The function %y is the modified Bessel function 
of the second kind of order > 0. Since \Ms — Mt\ = \OMs — OMt\ for any orthogonal 
matrix O, one can only identify M up to left multiplication by an orthogonal matrix. 
To remove this identifiability problem we suppose that M £ SL(d,M)/ SO{d,M) where 
SO{n,M) denotes the orthogonal matrices in SL(d,M). In the theorems below, we write 
Ml =sL/so -^2 to mean that there exists a O G SO(n,M) such that Mi = OM2, and 
similarly for Mi ^sL/so Operationally, however, we estimate a representer of the cosets 
in SL(d,M) / SO{d,'S.) given by the upper triangular matrices which have positive diagonal 
elements and determinant 1 (that this is a representer follows from the QR factorization, 
see dE]). 

As discussed in the introduction, the principle irregular term is important in determining 
the sample path properties of the random field Y. The principle irregular term for the 
Matern covariance function is 



^ ' -t^^logt, Hue 



A 



22i.-ir(jy)r(iy + 1) 



— vt^'^ ■, otherwise. 



where Gu{^) is defined to be 0. Moreover, 

(7) cov(y(t + h),Y{t)) = (T^Gy{\aMh\) - va'^Gy+i{\aMh\) + €{\aMh\) 

where e(/i) = (T'^p{\h\) + o{Gyj^i{\h\)) as \h\ and p is an even polynomial. Notice that 
when M is the identity matrix and ^ Z, this gives the expansion ([s]) so that a'^Gy{\ah\) 
is the first principle irregular term and —v(T^Gy^i{\ah\) is the second term. 
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2.1. Estimating a'^o?^ and M in any dimension. Let J7 be a bounded, open subset of 
and let 0„ = Q n {Z'^/n}. The idea is that we will be observing y on a region, just a 
bit larger than so that we can form the m*^ order increments of Y on These will 
then be used to estimate M and a'^a^'^ in any dimension and additionally a, in dimension 
d>A. 

For a fixed nonzero vector h define the increment in the direction h by /S.hY{t) = 
Y{t + h) - Y{t) and the m*^ iterated directional increment Af^Y{t) = AhA]^'"^y(i). The 
following lemma establishes the relationship between the variance of these increments and 
the terms in ([7| when the number of increments is sufficiently large. 

Lemma 1. Let Y be a mean zero, geometric anisotropic d-dimensional Matern Gaussian 
random field with parameters {a^a^u^M). If m is a positive integer such that m > v + 1 
and h is a non-zero vector, then 

m um 

as n —> oo where 



(9) a- ^ aW'^\Mhr E (-l)^^^|7j (^^ ) - j|) 




(10) 6- ^ aW'^^'whr^^ y: i-^y^' ( T ) 1 7 1 -jd. 

i,j=0 

Now we are in a position to estimate the coefficient a™- Let denote the cardinaHty 
of the finite set J7„ = $7 n {Z'^/n} and define 

(11) = ^ E n''{A^/„Y{j)f 

Notice that by equation (|8|, EQ™ — > a™ as n — > co. In addition, since is itself an 
average, one might hope that converges to d^. The following theorem shows that, 
indeed, this is the case. In addition, the theorem quantifies the decay of the variance of Q"^ 
as a function of the number of increments, the smoothness of the random field Y and the 
dimension of the domain. The heuristic is that when the number of increments m is large 
enough, there is sufficient decorrelation of the summands of to guarantee convergence 
as n — > oo. Generally, more increments leads to more spatial decorrelation and hence a 
reduction in variance. However, this only holds up to a point, after which taking more 
increments no longer effects the rate of variance decay. Finally, the higher the dimension, 
the more increments one needs to take to get the best rate. 
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Theorem 1. Let Y be a mean zero, geometric anisotropic d- dimensional Matern Gaus- 
sian random field with parameters {a,a,i',M) and let Q be a bounded, open subset ofW^. 
If m > v then 

(12) Q;r^<, y^-p-^ 

as n — > oo. Moreover, there exists a constant c > such that 



varQ";^ < < 



' c n^{^-"») , ifA{u-m)>-d; 
cn~'^logn, if A{y — m) = —d; 
cn"'^, if4,(y — m)<—d 



for all sufficiently large n. 



The above theorem estabhshes that Q"^ consistently estimates a™ (which depends on h). 
Now we show how these estimates can be used to recover M and a^a^'^ . As was mentioned 
above, we suppose M is upper triangular with determinant one and positive diagonal ele- 
ments. After renormalizing by known constants, the values of allow us to consistently 
estimate |M^p where M = a^^'^aM for finitely many directions h. We show by induction 
that these values are sufficient to recover each column of M. Once this is established, the 
requirement detM = 1 gives M = (detM)~^/'^M and a^a^'' = {det M)^"/'^. 

Let Mi J denote the element of M and let M._^i denote the i^^ column of M. Also 
let Mi-k,i:k be the submatrix with elements Mjj for i,j = 1, . . . ,k. For the first column of 
M, notice that |Mei| = Mi,i where ei, . . . , denote the standard basis of R'^. This follows 
since M is upper triangular with positive diagonal. For the inductive step suppose the first 
k columns M^i . . . , M^k are known. Taking h = Ck+i and h = Sk+i — allows us to recover 
and |M.fc+i — M-^i\'^ for i = l,...,k. By adding and subtracting appropriate 
terms we can then recover: (Al-^k+i, M-^i), for all i = 1,...,A; + 1. Therefore M-^k+i = 

I T 

{v,^J\M■,^k+l\^ - kP,0, . . . ,o) where v = M-^^^^^^((Af;,fc+i, M,^))^^^. This establishes the 

inductive step and therefore M can be identified from observing |M/ip at d{d+l) /2 different 
vectors h (let them be denoted by /ii, . . . , /j-d(d+i)/2)- 

Notice that as M ranges over the set of upper triangular matrices with positive diagonal, 
the transformation {|M/i| : h = hi . . . , hd(d+i)/2} M (M, a^a^'^) sends an open subset 
of M<^('^+i)/2 to SL{d,R) X M+. Since /2 o /i is a continuous map, 

{^^hx^, M) {a^a^"", M), w.p.l 



as n — ^ oo. 
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2.2. Estimating a, when d > 4. In this section we construct an estimate oi cr'^a'^'^'^'^lMhl'^'^ 
when d > 4, which, in combination with M and cr^a^'^, ahows us to consistently estimate 
a. We start by noticing that by Lemma [T] for any p,q > + 1 



np _ zJ^ng 



q 



as n ^ oo. The term hP — ^bf, is significant because, for any positive integer p, q 



If 



q 



where < c < oo is a known constant depending on p and q. In addition. Lemma [2] in the 
Appendix estabhshes that c 7^ and c 7^ 00 for at least one p,q > v + 1. Moreover, af,/a% 
doesn't depend on the unknown parameters ci^, a and M and therefore one can construct 
Qn ~ ^Qn from the observed values of the random field Y. The following theorem 



n 



quantifies how large p and q need to be for the almost sure convergence of -n? — ^Qn 
to bP- §bl. 

Theorem 2. Let Y be a mean zero, geometric anisotropic d- dimensional Matern Gaus- 
sian random field with parameters {a,a,v, M) and let Q. be a bounded, open subset ofW^. 
Suppose p q are positive integers such that p,q > u + 1 and both are large enough so that 
4 < min{2p — 2^, d} and 4 < min{2g — 2^, d}. Then 



n 



QP _ -^Qq 
q ^r, 



'M 



w.p.l 



as n 



00. 



Theorems [1] and [2] show that there exists strongly consistent estimates of a'^a^'^ , M and 



a a 



Mh 



2u+2 



This, in turn, gives consistent estimates of a, a and M. Notice that 



when d < 3 this is impossible due to the mutual absolute continuity of Matern Gaussian 
random fields with different scale and variance parameters (see Zhang p3]). Since Gaussian 
measures are either mutually absolutely continuous or orthogonal, the fact that we have 
strongly consistent estimates of a, o" and M gives the following corollary. 



Corollary 3. Let Yi and Y2 be two, mean zero, geometric anisotropic d-dimensional 
Matern Gaussian random fields defined a bounded open setQ. C M*^ with parameters (cii, ai, v, 
and ((T2, 02, M2) where d > 4. If (ui, ai) / (o"2, 02) or Mi i^sLjso ^^2 then the Gaussian 
measures induced by the random fields Yi and Y2 are orthogonal. 
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Remark: The strong consistency results for our estimates of a'^a'^'^, a and M all depend 
on knowledge of the true value of u. However, our results can be extended when using an 
estimate u so long as the error e„ = z> — satisfies e„ log n ^ with probability one as 
n oo. This follows since the ratio of the quadratic variation, Q^, using the true u, to the 
quadratic variation using the estimated i), is n~^" which converges to 1 if e„logn — > 0. 

3. Beyond the Matern. The previous section dealt exclusively with the Matern au- 
tocovariance. Now we show how these results can be extended to other autocovariance 
functions. We choose two examples to illustrate how the methodology can be easily ex- 
tended beyond the Matern autocovariance function. The key components for showing ex- 
tensions are establishing versions of Lemmas [T] and |4| Lemma [T] quantifies the expected 
value of the squared increments (A^^^y(t))^ in terms of n. Lemma |4j establishes that, in 
effect, derivatives of the covariance away from the origin are dominated by the derivatives 
of the principle irregular term. Once the analogs of these Lemmas are established all the 
subsequent arguments for versions of Theorems [T] and [2] follow almost immediately. 

For our first example we consider the case when y is a mean zero Gaussian random 
field on M'^ with generalized autocovariance function ciltl*^! + C2|t|''^ where 6i and ^2 are 
known but ci and C2 are unknown (it is tacitly assumed that the values of ci and C2 give 
a conditionally positive definite function of order [^2/2 J in W^, see In what follows we 
suppose 82 > Si > and neither are even integers. The appropriate version of Lemma [T] 
says that when p > 82/2 

(13) E(A-,/„y(t))^ = ^ + ^ 



where Cp^s = 1^1 Efj=o(-l)*"*"^ (i) (P N - il • Now Qp is defined as in (11) with 61 in place 
of 21/. In this case, EQ^^ = ciCp^Si + C2Cp^52^''^~''^ and therefore we set ci = QP^/Cp^Si- Also, 
for an integer q > p we have En^'^~^^ [Q^ — '^pj^Qn] = C2[Cp^s^ — ^^f^Cq^s^] and after a 
renormalization one gets the estimate C2- The analog to Lemma |4] says that when p > 62/2 
and $7 is a bounded open subset of M'^ there exists a constant c > such that 

(14) |5}f'^^cov(y(s),y(t))| < c\s-t\^^-^p 



for all s,t G such that s ^ t. Once (13) and (14) are established, versions of Lemma [6j 
Lemma[7j Lemma|8]and TheoremIT] following by replacing 2v with 5i. To establish Theorem 
[2] replace the v? term with n^'^~^\n equation (47) and continue in an similar manner to 
establish the following theorem. 

Theorem 4. Suppose Y is a mean zero Gaussian random field on with generalized 
autocovariance function ci\t\^^ + C2\t\^'^ observed on rJnjZ'^/n} where il, is a bounded open 
subset o/M'^ and < 61 < 62 are known and not even integers. If < 2(^2 — 61) < d then 
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there exists integers q > p > such that c\ and C2 (defined above) converge with probability 
one to c\ and C2 (respectively) as n ^ oo. 

There are different conditions on p to guarantee convergence of ci versus 02- Generally, 
one only needs p > di/2 for consistent estimation of ci, which will hold in any dimension. 
However, in our case, we need the additional requirement that p > 82/2 since we are working 
with a conditionally positive definite function of order [^2 /2j . To get consistent estimation 
of C2 we need the additional inequality 2(82 — Si) < mm{2p — 6i,d}. To relate this to our 
Matern results in Section |2] set 61 = 2v and 82 = 2z/ + 2 so that the inequality becomes 
4 < min{2p — 2i^, d} which appears in Theorem |2j Finally the analog to Lemma |2] guarantees 
there exits a q > p such that [Cp^Si — zrj^^i,^2] non-zero which allows us to define C2- 

Before we continue, we mention a comment in Wahba's book ([31], page 44) which argues 
in favor of using the generalized autocovariance over the model Ifp"*"^ -|-ci|tp™''''^ + 

• • • -|-Cfc|tp™'"*"^'^~^ when d = 1, 2, 3. The reasoning is that the two models yield mutually ab- 
solutely continuous Gaussian measures, and therefore can not be consistently distinguished. 
We can see, however, that the dimension requirement d = 1, 2, 3 is an integral component of 
this argument. When the dimension gets above 4, this reasoning no longer holds since the 
two models are orthogonal by the above theorem (setting 61 = 2m — 1 and 82 = 2m + 1). 

For our second extension we show that the variance o"^ and scale a can be separately 
estimated in the exponential autocovariance model u'^e"!"*! when the dimension d > 25 
and 7^ 1. In this case, the appropriate version of Lemma [T] becomes 



(15) E(AS;,„V(*))= = + + o(„-») 



as n — > cxD when p > 6/2. From (15) one can now easily construct estimates of a'^a^ and 
a'^a^^ . When a geometric anisotropy M is present, the techniques of Section E] a re also 



sufficient to also construct M. Notice that by direct differentiation, equation (14) holds 
when 5i is replaced by 6. Using similar arguments for the previous theorem and extending 
to a geometric anisotropy the following theorem is obtained. 

Theorem 5. Let Y be a mean zero, Gaussian process on with autocovariance func- 
tion (T^e~l°^''^*l observed on n {Z'^/n} where 0, is a bounded open subset o/M"^. Suppose 
5 G (0, 2) is known, a and a are positive and M is upper triangular with positive diagonal 

and determinant 1. Ifp > 1 then a'^a^ a'^a^ and M ^ M with probability one as n ^ 00. 
Moreover, if 26 < d and 6^1 then for any p > 36/2 there exists q > p such that a ^ a 
and a ^ a with probability one as n ^ 00. 

Many other extensions are possible, including more general non-stationary random fields. 
In this case, both aJT" and 6^ depend on t E $7 and will convergence to Jq a^dt and 
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similarly for ^ ~ dt. li one also needs pointwise convergence to a™ oi — 

one can consider weighted local averaging of the terms in Qp^. This was the technique used 

in ID when observing a deformed isotropic Gaussian random field that locally behaved like 

a fractional Brownian field. However, obtaining extensions in these cases are more difficult 

since one needs to consider rates of decay for a bandwidth parameter. That being said, this 

work leaves open the possibility of constructing consistent estimates of the two deformations 

fi 1 /2 when observing o + I2 ° /2 where Yi and Y2 have generalized autocovariance 

functions Itl"^^ and \t\^'^ respectively. Finally we mention that since is constructed from 

increments, one can extend our results to random fields Y with a polynomial drift of known 

order. 



4. Simulations. We finish with two simulations that illustrate (and hopefully com- 
pliment) our theoretical results. The first simulation shows how one can use directional 
increments to estimate a'^a'^'^ and a geometric anisotropy M using finitely many directions. 
The second simulation shows how to estimate the coefficient on the 'second principle irreg- 
ular term' (c2 in equation ^) and how it can be used to construct an unbiased estimate 
of the coefficient on the 'first principle irregular term' (ci in equation Q). 

In our first example, we simulated 500 independent realizations of a Matern random field 
with parameters a = 1.5, a = 0.8, u = 1.75, Af(l,l) = 1.2, M(l,2) = 0.5, M(2, 1) = 
and M(2,2) = 1/1.2 observed on a square grid in [Ojl]'^ with spacing 1/55. On each 
realization we estimated a'^a'^'^ and M using 2, 3 and 4 horizontal, vertical and diagonal 
increments. Notice that since 1 < v < 2, this random field is once, but not twice, mean 
square differentiable. Intuitively, we therefore need at least two increments for sufficient 
de-correlation of the terms in the quadratic variation sum Q . Table [T] displays the root 
mean squared error (RMSE) for estimating a'^a^^ , the true value is approximately 1.03, 
and the elements of M. Figure |2] plots histograms of the estimates for 2 and 3 increments. 
It is immediately clear that there is a large reduction in RMSE when using 3 increments 
as compared to 2 increments (and an additional bias reduction when estimating a'^a^'^). 
Indeed, by Theorem [T| more increments leads to more spatial decorrelation and hence 
a reduction in variance. In this case, u<2<v + \so that the estimate based on 2 
increments is guaranteed to be consistent but the variance decays at a sub-optimal rate. 
Since 3 > (4z^ -|- d)/4 = 2.25, the variance of the estimate based on 3 increments decays at 
the optimal rate. However, Theorem [T] also says that this variance reduction only holds up 
to a point, after which taking more increments no longer effects the rate of variance decay. 
Indeed, it is seen in Table [T] that taking 4 increments do not improve the RMSE nearly as 
much. 

Our second simulation uses the results of Section [3] to estimate ci and C2 when observing 
y/ciYi + y/c2Y2 on [0, l/\/2)2 at 1000 x 1000 pixel locations where ci = 100, C2 = 36 and 
Yi is independent of Y2. The random field Yi has autocovariance — -|- and Y2 

has autocovariance ^ — It]"'^ -|- which is positive definite on [0, l/\/2)^ (see [29j for a 
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Table 1 

RMSE for estimating a^o?'' and M using 2, 3 and 4 increments. 





2 increments 


3 increments 


4 increments 




0.1664 


0.0300 


0.0289 


M(l,l) 


0.0360 


0.0114 


0.0113 


M(l,2) 


0.0475 


0.0147 


0.0147 


M(2,2) 


0.0248 


0.0079 


0.0079 



proof) . Our estimates of ci and C2 are defined by 
(16) ci ^ QP/Cp,s, 



Cr, 



A ^<52-5i_!!;__^Wl 



(17) C2 = n 



where = 0.2, 62 = 0.4, p = 2, g = 3 and Cp,s = EC,=o(-l)'+' (i) (P K " il^- 

This example was chosen to illustrate the duality when estimating ci and C2: the smaller 
I (^i — (^2 1 (in relation to the dimension d) the smaller the variance of ci and C2 but the larger 
the bias of ci. In fact, as the dimension grows, the variance ci decreases at a faster rate 
(proportional to n^'^ when using enough increments) but the bias decreases at the same 
asymptotic rate for any d (proportional to n^^~^^). In our example, since p = 2 (so the 



quadratic term Trj\t\'^ vanishes), we can explicitly compute the bias using equation (13) so 



that Eci = ci + C2r^^n^^ Notice that using our estimate of C2 we can now correct the 
^'''^ 1—1 

bias in ci . The left plot of Figure pi shows two histograms of the estimate ci and the bias 

c — 

corrected estimate ci — C2r^^n^^~^^ on the 500 simulated realizations. The right plot of 
Figure [3] shows the histogram of the estimate £2. We can see that not only is it possible to 
get an estimate of C2, but using it to correct the bias in ci reduces the RMSE for estimating 
ci (from 7.84 down to 2.29). 

APPENDIX A: PROOFS 

We start with some notation. For a function of two variables F{s,t) let a[^"'"^F(s, t) = 
A^A^F{s, t) where acts on the variable s and A^ acts on the variable t. Define 
dh = ^-V to be the directional derivative in the direction h and d^^'""^ F{s, t) = 5^9^F(s, t) 
where d'f^ acts on the variable s and acts on t. 

Let /(^),5(C) be real valued functions defined on some set H and let H' C H. We write 
f{0 ^ 9{0 loi' C £ if there there exists a positive constant c > such that |/(^)| < 
cg{S) for all ^ S r! . Notice that this definition also works for a sequence of functions fn,9n 
by considering the variable n as an argument and replacing H by S x N. 

Proof of Lemma [ll We suppose a = a = 1 and M is the identity matrix, then rescale 
for the general case. First note two immediate facts about the m^^ directional increment 
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SO 



60 



= 40 



20 



using 2 increments using 2 increments using 2 increments using 2 increments 
— ■ ^1 ■ 1 lOOi • ^ • 1 80| ' . ' 1 lOOr- • p • — 



0.8 



1 



1.2 



estimates of o g 
using 3 increments 



1.1 1.2 1.3 
estimates of M(1,1) 



using 3 increments 



0.4 0.5 0.6 
estimates of M(1, 2) 



using 3 increments 



0.75 0.8 0.85 0.9 
estimates of M(2,2) 

using 3 Increments 




80 r 



60 



40 



20 



1.1 1.2 1.3 
estimates of M(1,1) 



0.4 0.5 0.6 
estimates of M(1, 2) 



0.75 0.8 0.85 0.9 
estimates of M(2,2) 



Fig 2: 500 independent simulations of a Matern random field with a = 1.5, a = 0.8, 
u = 1.75, M(l,l) = 1.2, M(l,2) = 0.5, M(2,l) = and M(2,2) = 1/1.2 observed on a 
square grid in [0,1]^ with spacing 1/55. The top row of figures shows the histograms of 
the estimates of ((T^a^^,M(l, 1), M(l, 2), M(2, 2)) using the techniques derived in Section 



2.1 based on increments of order 2. The bottom row shows the histograms of the estimates 
using increments of order 3. 



operator AJ^y^: for any function /: M the m^'^-increment of / can be computed 

A'^/Jit) = EZodifit + ih/n) where di = (-l)"^+'(7); The mtMncrement A™/„ annihi- 
lates monomials of degree less than m so that A|^^"^^|t — s\'^^ = for all A; = 0, . . . , m — 1. 
Therefore, by the expansions given on page 375 of [1^ we have 



t|) = Aj,7f){G.(|s-t|)-i.a+i(|s 
where r(e) = o(e^^+^) as e ^ 0. Now for a fixed to G 



t\)+r(\s 



E{A^^^Y{to)f = A^^f{K{\s-t\)} 



S,t=to 



140 

120 

100 

„ 80 
o 
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I ^ Estimate of c. 

Bias corrected estimate of c . 



100 

estimates of c. 





20 40 

estimates ofc„ 



Fig 3: Histograms of the estimates of ci and C2 for 500 independent realizations of y/ciYi + 
-y/c2l2 where ci = 100, C2 = 36 and Yi is independent of Y2. The random field Yi has 
principle irregular term — Itl*^'^ and Y2 has principle irregular term — Each realization 
is on [0, l/\/2)^ measured at 1000 x 1000 pixel locations. 



where 
(18) 

(19) 

(20) 



<7rH^-(l^ - *l)} =J:d^d,GM{^ - j)h/n\) 



S,t=to 



Y,d.-4,{-v)G,+i{\{i-j)h/n\) 



h ^ a!:;^ ){r(|s - t|))} = ^ d.d,r{\{i - j)h/n\) 



Notice that didjG,y{\{i — j)h/n\) = \h/n\ Yl,ijdidjGu{\i — This is obviously true 
with Z. It also holds when v ^7L since 



(21) 



G.m - j)h/n\) = Ih/nl^'iG^ili - j\) + \z - jr log I V"!) 



and Yliij didj\i — j\ = (since 1/ G Z and m > v). Similar arguments can be applied to 

Gyj^i when m> v + 1 which gives Ji +J2 = ^ + ^ai'+a • Finally, notice that r(e) = o(e^'^+^) 
implies that J3 = o{n~'^'^~'^). This establishes the claim when a = a = 1 and M is the 
identity matrix. The general result when a, > and M S GL{d, M) is then established by 
an easy rescaling argument (using equation (21 ) when G Z). □ 



Lemma 2. For u > 0, let a™ be defined by ^ and be defined by (10). If m > u then 
a™ / 0. Ifm>u + l then / 0. Finally, there exits p,q> u + 1 such that bf, - / 0. 
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Proof. Notice first that a™ oc var(Aj"Zi,) > where Zy is an intrinsic random function 
on M observed on 7L with generalized covariance Gy (since A™ annihilates polynomials of or- 
der m—1, and m > u, see p8]). The same reasoning establishes that —6^ oc var(Aj"Z,y+i) > 
when m > v + 1. 

For the last part of the lemma we show that there exists p,q > + 1 such that 

vai{A{Zy) _^ var(A^Z,,+i) 
var(A^Zi,) var(A^Z,,+i) ' 

We will argue by contradiction and suppose that for all k > 0, 

var(Af+^Z,) _ var(Af 



(22) 



var(A?Z^) var(A?Z; 



u+l) 



By a spectral representation of (see [28] page 36) and an easy induction establishes that 
var(A?+'^Z^) = / |e™-l|2'?+2fc|u;|-2'^-i dy; and var(A?+'^Z^+i) = / le'"^ -l\'^i+^^\w\-^''-^ dw. 
Notice also that le*"' — Ip = 2 — 2 cos w. Let Fi, and F^^i be two probability measures on 
M defined by 

F^B)^ ,1,^, [ (2 -2 cos wr\w\-^''-Uw 
var(AjZ,^) Jb 

1 

y+l' "' 



var(AjZy+i) Jb 



Fy+AB) ^ ^ / (2 - 2 cos wY\w\-'^'''^ dw. 



Our assumption (22) then becomes 



(23) / (2 - 2 cos wfdFy{w) = / (2 - 2 cos wfdFy+i{w), 



for all /c > 0. Notice that the variances var(A^Z,y) and var(Aj'Zj^+i) serve as the normalizing 
constants so that Fy and -Fv+i have total mass one. In what follows we show that the nor- 
malizing constants satisfy both var(A^Z;y) > var(A2'Ziy-|_i) and var(A^Z,y) < var(A^Z,y4_i) 
to establish the desired contradiction. 



By the equalities in (23), the random variables 2(1 — cosWy) and 2(1 — cosVFjy+i) have 
the same moments when Wy ~ Fy and Wyj^i ~ Fj^+i. In addition, < 2(1 — cosWy) < 4 
and < 2(1 — cos Wy+i) < 4 so that the moment generating functions are both finite in a 

non-empty radius of the origin. Therefore 2(1 —cos Wy) = 2(1 —cos Wy+i), where = denotes 
equality in law. This gives P(cosW;y < 0) = P{cosWy+i < 0), for example. However 

P(cosW^, < 0) = I [ l{cos«,<o}(2 -2 cos wy\w\-'"'-Uw 
vai[L\^Zjy ) J 

> flqr^ . I '^{cosw<o}{2 - 2coswY\w\''^''-^dw, 

Yai{I\iZy) J ^ ' 
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by the fact that cosw < \w\ > tt/2. Therefore 

(24) var(A?Z^+i) < var(A?Z^). 

To show the contradicting inequahty let's start by computing the density of these two 
random variables. The idea is to show that the non-normalized (i.e. without the term 
var(Aj'Z,y)) density of 2(1 — cos Wj^) is strictly smaller than the non-normalized density of 
2(1— cos Wi/+i) in a positive neighborhood of 0. In particular, the density of 2(1— cos W^) can 
be written as '2J2'k^=i fw„{9k{x))\gkixy\ where the gkS are the different positive branches 
of the inverse cos~^(l —x/2) and fw,A''^) — (2 — 2 cos t«)''|?i;|~^'^~^/var(A^Z,y) is the density 
of W^. This simplifies to 



2x1 



E 



\9k{xy\ 



2x1 



var(A?Z^) \gkix)\ 



\2u+l 



var(A'?Z.)yS^^^ £ l5fc(^)r''^-' 



for < X < 4. Notice that gi{x) ~ ^/x as a; — > and gk{x) ~ 27r[A;/2j as x ^ for all 
k > 1. Therefore the term gi dominates the sum when x is small. In particular for all x > 
sufficiently small we have 



(25) 
(26) 



2x1 ^ 
f----^^^^^ <var(A?Z.)ySr3^El^^(-)r 



var(A^Z^+i) 
var(A'/Z^) 



/2-2cosvy„+i(a;)- 



Since f2-2cosWi,{x) and /2-2 cos 14^^+1(2;) have the same integrate integrals over Borel subsets 
of (0,4), we must have var(A^Ziy_|_i) > var(A^Z, 
establishes the lemma. 



This contradicts (24) and therefore 

□ 



Lemma 3. For any 1/ > 0, T > 0, 

(F 



dtp 



when p < u; 



f/'^X^iVi) < <^ |logt|, whenp 



when p > u; 



as t ranges in the interval (0, T) where %y is the modified Bessel function of the second 
kind of order u. 



Proof. Using the expansions for "X^ found in (page 375) we can write 
(27) t^'^%,{^t) 



Fi(t) +t^log(t)F3(t); when 1/ = 0,1,2, 
Fi{t) + t" F^{t)] otherwise 
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where the Fj(t)'s are of the form X^fc^o '-fc^'^ where the c^'s decay fast enough so that the 
series converges absolutely for all t S (0, oo) and all it's derivatives exist and are bounded on 
(0,r). This immediately establishes that when p < i^, l-^^f/^XuiVi)] < 1 for ah t G (0,r) 
since both ^{f^) and ^{f^logt) are continuous and bounded on (0,T). 

When p > 1/ and 1/ Z we have that t" < ^^{1") < ■ ■ ■ < ^{t") < as t ranges in 
the bounded interval (0,r). Similarly, when p> u and G Z we have 

d dP 
f log t<-{f\ogt)<---< —{f log t) < t^-P. 



Finally, when p = v, ^t^\ogt oc logt + Cp. The lemma now follows by equation (|27|) and 



the fact that the derivative of a product satisfies {fg)^P^ = Z]fc=o (H^f^^'^d^^ 



(p-k) 



□ 



Lemma 4. Suppose K{t) is the isotropic Matern autocovariance function defined in ^ 
for fixed parameters a^a^v > 0. Then for any integer m> v, nonzero vector h G W^, matrix 
M £ GL{d,R) and bounded set ^cW^ 

(28) IS^""'™^ [K{\Ms - Mt|)] I < |s - tp'^-s™ 

for all s, t G such that s ^ t. 

Proof. First notice that it is sufficient to show the claim when M is the identity matrix 
and a = 1 (extending to general M and a follows by the chain rule for derivatives). Define 
Ks,{t) = K{Vi) and F{s,t) ^ so that d'^'"'\K{\s - t\)] = dl^'"'\Ksg{F{s,t))]. 

Also let 9^ denote a generic directional derivative on either the variable s or t. By generic 
I mean that (dD'^F denotes d^l'^^ F for some i + j = k and {dlFf = dlF ■ ■ ■ d^F where 
each could be with respect to s or t. Now by successive application of the directional 
derivatives we get that 

2m 

(29) dt'"'\K,,iF{s,t))]=i: E Ki^iF{s,t)){dlFis,t)y-^B,j 

i=l 0<j<i 
j+i<2m 

where each Bij is uniformly bounded on O^. The functions Bij are uniformly bounded by 
the nice fact that {dl)''F{s,t) < 1 on fi^ ^^en k>2. 



We will bound the terms of the sum (29) when i < u, i > u, and i = u separately. Notice 
first that since i > j we have that 

(30) \dlF{s,t)\''^ <\s -tf-^, ioi alls, ten. 
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This implies, by Lemma |3j that the terms in the sum (29), for which i < u, are bounded. 
When i > u 

\Kii]{F{s,t)){dlF{s,t)y-^B,,\ < \F{s,t)r'\s - t^^ , by ^ and Lemma| 

= |s_t|2<^-(»+i) 

<|s-tp''-2™, since i + j< 2m, 

where the inequality holds for all s,t £ Q such that |s — t| > (note that we use the 
fact that 17 is bounded implies |s — t| < T for some T). For the last case, i = v, a similar 
argument establishes 

\KS{F{s,t)){dlF{s,t)y-^B,,\ < \s-tr^\logF{s,t)\ 

< |s-t|2^-2m 

for all s,t G O such that |s - t| > 0. Therefore O^""'""^ [^^^(^(s, t))] < |s - t|2i'-2'n for ah 
s, t G O such that s ^ t. □ 

Lemma 5. Let h be a nonzero vector in W^, > and H be the d x m matrix defined 

by 

(31) H^ jh,... ,h\ . 

m columns 

If m is a positive integer greater than u then 

sup \i-3 + H{i - r7)/n|2-~2- < | • _ .^2u-2^ 

^,77G[0,l]™ 

for all positive integers n and i,j G 0,n such that \i — j\ > |(m + l)h/n\. 

Proof. First notice that sup^^^g[o i]m \i — j + — ?7)/np^~^'" = sup_i<^<i \i — 
j + mhr / n\'^'^~'^"^ . Now for any — 1 < r < 1, positive integer n and i,j £ r2„ such that 
|i — j'l > |(m + l)h/n\, we have 

\i — j + mhr/nl > \i — j\ — m\T\\h\/n 

>\r- 3\-\t- 3\ 



m+1 



The last line follows from the assumption that |« — j| > {m + \)\h\/n which implies 
jf'l > m\h\/n. Therefore 

2u-2m , /, m ^2u-2m^_ ,,2u-2m 



sup \i-j + H{$,-r])/n\ < 1 — \i - j 

$,r,G[0,l]- ^ 



□ 
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Lemma 6. Let Y be a mean zero, geometric anisotropic d- dimensional Matern Gaussian 
random field with parameters {a^a^v, M) and let he a bounded, open subset ofW^. Fix a 
positive integer m > v and a non-zero vector h . Let S to be the covariance matrix of 
the increments A]^^^y(i) as i ranges in the set i £ 0,n so that 

(32) S(i,j)^E(A-/„y(i)A™/„y(j)) 
for all i,j G Then there exists an N > such that 

(33) |S(i,j)|<n-2™|i-jf-2- 

for all n> N, and i,j £ 0,n such that \i — j\ > |(m + l)h/n\. Moreover, 

(34) |S(i,j)|<n-2^ 

for all n > N and i,j € 0,n such that \i — j\ < |(m + l)h/n\. 

Proof. First notice that j) = EAj;^/„y(i)A™/„y(j) = a'^^'J^^ K{\M{i - j)\) where 
K is the isotropic Matern autocovariance function defined in Q. To sirnplify the notation 
let F{i,j) = K{\M{i — and H be the d by m matrix defined in (31). An induction 
argument on m estabhshes that when |i — j| > {m + l)|/i|/n we can express directional 
increments as integrals of directional derivatives so that 

A^;^fF{i,j) = 4^ / (5f ''")F)(i + H^/n,j + Hrj/n)d^dv. 



Therefore 



\^{i,3)\ f \{dt'"''^F){i + H^/n,j + Hrj/n)\d^drj 

< I \i- 3 + - r])/nf''~'^"'d^dr], by Lemma|4] 



1 



2u-2m 



~ I * - J I by Lemma [5] 

for all n > N, i,j £ 0,n such that \i — j\ > |(m + l)h/n\. On the other hand when 
K ~ jI ^ \{'m' + l)h/n\ 

-2u 



(35) j)| < y'E(A-„y(i))yE(A-„y(j))2 < n 

where the last inequality is by Lemma [TJ Actually, a direct application of Lemma [T] only 
establishes (35) when m > u + \. However, a small adjustment of the proof of Lemma [T] 
establishes that E(Aj^^^y(t))^ = + o(n~^^) as n ^ oo when m > u. This is then is 
sufficient to establish (ISSl). □ 
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Lemma 7. Let T,abs the component-wise absolute value of the covariance matrix S 
(defined in (32)). Then under the same assumptions as in Lemma^ there exits an N > 
such that 

Jl/n 

for all n > N, where c is a constant and \\ ■ \\2 is the spectral norm. 



Proof. First note that by symmetry, USabsIb < Vll^abs||i||Sabs||oo = ||Safes||oo, where 
1 1 ^afes I loo is the maximum of the £i row norms and is the maximum of the li 

column norms. To bound the £i row norms, we bound the terms of the sum when |i — j| > 
(m + l)|^|/n and \i — j\ < (m + l)|/i|/n separately. For the off-diagonal terms we use 
Lemma [6] to ensure the existence of an > such that for all n > 



(36) max ^ |S(i,j)|<max ^ n-'^"'\i - j 

\i~j\>{rn+l)\h\/n |i- j|>{m+l)|h|/ri 

(37) < n'^^^m ^2v-2m+d-l^^_ 

^ Jl/n 



■\2p-2m. 



The last inequality, (37), follows by the fact that for any constant a > and open set 
C M'^ which is bounded and contains the origin, one has 



(38) ^ / r^^'^-^dr 

\i\>a/n 

as n ^ OO (for details see [3], Lemma 3, page 41). In addition, by Lemma [6] 



(39) max ^ |S(i,j) 

\i-3\<{m+l)\h\/n 



^ -2v 

5, n 



for all n > N . This establishes the proof by noticing that the sum of the last terms in (37) 
and (39) bound ||Sabs||oo- D 

Lemma 8. Under the same assumptions as in Lemma^ there exits an N > such that 

Jl/n 

for all n > N where c is a constant and \\ ■ \\f denotes the Frohenious matrix norm. 
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Proof. First note that ||S||^ = jerj,j A-S in the proof of Lemma [s] we bound 

the near-diagonal terms of S separately from the off-diagonal terms. By Lemma |6] there 
exists an > such that 



(40) 



(41) 



E 



\i-j\>{m+l)\h\/n 



E 

\i-j\>{m+l)\h\/n 
1 



^-2d|j__y|4i/-4m 



1/n 



for all n > N. Notice that the last inequality is a slight variation on (38). For the near 
diagonal terms we also use Lemma [6] to get 



(42) 



E 



|s(i,j)p 



< 



n n 



-Av 



\i~3\<{rn+l)\h\/n 



Adding (41) and (42) establishes the lemma. 



□ 



Proof of Theorem 1. Define the random vector Ay to be the vector of m-increments, 
the components of which are indexed by J7„ (in any order), so that 



(43) 

Now we can write QJ! 



Ay 4 (...,A-/„y(j),...) . 

" V ' 

terms are indexed by j G Q,n 



^AYAY^ = ^W^W^, where W ~ 3M"(0,/) (note that S is 
defined in ( 32 ) ) . Therefore var = 2," " 



|S|||i and by Lemmajsj 



n 



Au—Am 



^Av-Am+d-l^^ 



1/n 



n^iy-m)^ if 4(z^ - m) > -d; 
< ^ tT'^ log n, if 4(z^ — m) = —d; 
n~'^, if 4(z^ — m) < —d 



for all sufficiently large n. This establishes the variance rates. 

For the almost sure convergence result let S = rBri^'^abs where S^ts is the component- wise 
absolute value of S. The Hanson and Wright bound in [T7] then gives 



(44) 



P(IQ;r-^Qnl>e)<2exp 
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for all e > 0, where ci,C2 are positive constants not depending on n or S. First notice that 
by Lemma [7] we get 



(45) 
(46) 



n 



2u 



< 



n 



2u-2m 



r 



2v-2m+d-l 




+ cn 

"l/n 

^2(^-m)^ if 2(z^ - m) > -d; 
'^logn, if 2{v — m) = —d; 

if 2{u -m) < -d. 



dr 



for sufficiently large n. Also notice that this implies that < ll^lb for sufficiently large 

n. Therefore for sufficiently smah e, P{\Q'^ - EQ^\ > e) < 2exp (-C2eVl|S||2) • Now the 
rates in (46) and the Borel-Cantelli Lemma are sufficient to establish that — EQ™ — > 0, 
with probability one as n ^ 00. By Lemma [T] EQ™ — > a™ (a slight adjustment also proves 



the case when m> v rather than m > + 1) which establishes the theorem. 
Proof of Theorem 2. First notice that when g > + 1 



□ 



(47) 



En^ 



Ql 



a 



p ■ 



as n ^ 00 by Lemma [T] To get almost sure convergence notice 



(48) 
(49) 



^ O1IJ fill/ 



> e 



< P{\[QP - EQP| > e/2n') + P(|a^||Q^ - EQl\ > \al\e/2n') 

We can again use the Hanson and Wright bound ( [17J ) and the rates derived in Theorem [T] 
to get 



(50) 



P(|QP-EQ^|>e/2n2)<2exp 



-cn ^e^/ 



for all sufficiently small e > where c is a positive constant that doesn't depend on n 
or S. By inspection of the rates in (46) the Borel-Cantelli Lemma can be applied when 

00. A similar 



4 < min{2p -2i^,d} so that QP - EQP 



with probability one as n 



result holds for the second term in (49) using the fact that both and are non-zero 
by Lemma [2J This, combined with convergence of the expectation in (47), completes the 
proof. □ 

Proof of Theorem 4. First notice that for any p > 62/2 

(51) ^(K/nYi^))' = 4'/? {cil^ -y\'' + -y\''} 

(52) 



x=y=t 



n 



Si 



n 



&2 
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where C„ 



function of order [(52/2J with generahzed autocovariance function ci| • 1*^^ + C2I • |''^ and A^^^ 
is an allowable linear combination of order [^2/2] (see [9]). Now is defined as in (11) 
with 61 in place of 21/ so that 



This follows since Y is an intrinsic random 



For any integer q,p > ^2/2 we have that EQ^ = ciCp^Si + C2Cp^s2''^^^ ^^'^ ''^^^ ^^^[Qn 



C. 



C„ 



-Cg^^j] • By a proof similar to Lemma 



one can show that for any 



p > 62/2 there exists a q > p such that Cq^s^ / and Cp^s2 ~ cT^^iM 7^ ^ (this uses the 
fact that 5i, 82 are not even integers). This motivates the following definition 



(53) 
(54) 



^2 A„52-5i. 



Ql 



p,&2 



c, 



In what follows we show that p > 82/2 implies ci ci as n - 
min{2p — 81, d} then there exists a q > p such that C2 C2. 



00. Moreover if 2 ((52 — (5i) < 



We start by letting S(i, j) ^ E(A^/^y(i)AP/„y(j)) for ah i,j G 17„ and S 



A n"! 



where T^abs is the component-wise absolute value of S. The Hanson and Wright bound in 
[T7| gives 



(55) 



P(|Q5^-ii;Q^,| >6) <2exp 



A 



626^ ^ 



for all e > 0, where 5i, 62 are positive constants not depending on n or S. Later in the proof 
we will show that when p > 82/2 



n 



Si~2p 



(56) 



< IISII2 < 



n 



d 



n log n, 



iiO>Si-2p> -d; 
if 81 — 2p = —d; 
if 8i-2p < -d. 



for all sufficiently large n. First, however, we show this is sufficient for the almost sure 
convergence result. Equations (55) and (56) immediately establishes that ci ci when 
p > 82/2 since \QP - EQp\ 
notice that 



(57) 



P{n''-'^QP,-EQPJ>e)<2eKp 



by Borel-Cantelli and Eci ci. To see that £2 C2 
' h2^ \ 



n 



2(<52-<5i)|||i||2 
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for all sufficiently small e > and sufficiently large n. Therefore, by inspection of the rates 
in (56), one can show that n^'^~^^\Q^ — EQ'^\ whenever 2(62 — Si) < min{2p — 61, d} 
and p > 62/2. Since Ec2 = C2, this is sufficient to establish that there exists a q > p such 
that C2 C2 as n — > 00 when < 2(62 — Si) < min{2p — Si,d} and p > S2/2. 

Now to finish the proof we need to establish ( |56| ). We start by noticing that for any 
p > S2/2 there exists a constant c > such that 

|a^''^)cov(y(s),y(t))| = \di^'P^{ci\s-t\^' +C2\s-t\^^}\ 

for all s,t S Q such that s ^ t where 64 is a positive constant. Following the proofs of 
Lemma [g] we can then derive that there exists an > such that for any p > S2/2 

|S(i,j)|<n-2P|i-jfi-2p 

for all n > N, and i,j € On such that |i — j| > \{p + l)h/n\. Moreover, 

\ni,j)\<n-'- 

for all n > and i,j G i7„ such that \i — j\ < \{p + l)h/n\. Now by direct analogs to 
Lemma [Tj Lemma [S] (by replacing 2v with Si) we have 

(58) IISII2 < n^^ + fesn-'i-^P r^^-^^+'^-^dr 

Jl/n 

(59) < n-^ + 66 n^-'i-^P T ^2<Si-4p+d-i^^ 

where 65, fte positive constants. These equations hold when p > ^2/2 and are sufficient 
to establish (56). This completes the proof. □ 

Proof of Theorem 5. First notice that since e"l*l* = 1 - \t\^ + |tp'^/2 + 0{\t'^^) one 
can show that for any p > 1 

(60) E(A^/„y(t))2 = A^JJ {a^exp [-\aMx - aMy\'\ } 

(61) = -a''a'\Mh\'^ + cj''c?'\Mh\^'^ + ©(n'^^) 

where -Dp^5 = X]?j=o(~l)*~''"' (?) (j) 1^ This follows by a proof exactly similar to that of 

Lemma [TJ 

Now is defined as in (11 ) with S in place of 2z^ so that 



x=y=t 
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Therefore 

(62) EQP = -a'^a^\Mh\^Dp^s + 0{n-^) 
and 

(63) En^K - ^Ql] = "'"''If'^''' [Dr>,2S - ^D,,s] + 0{n-\ 

By a proof similar to Lemma |2] one can show that for any p > 1 one has that Dq^^ ^ and 
if, additionally, p > 5 there exists a q > p such that and Dp2S — jf^Dq^2S / (this uses 
the fact that 25 is not an even integer). This motivates the following definition 

(64) cj2c?jM/i|'5 ^ -Ql/Dp^s 

QP _ Dp,S QQ 

(65) a^a^hl^s A 1 ^"-^ " . 



In what follows we show that for any p > 1 we have that a^a^\Mh\^ a'^a^\Mh\^ as 
n — > oo. Moreover, if 25 < min{2p — 5,d} and p > 5 (this is required to guarantee that 

Dp,2S / 0) there exists a q > p such that and a'^a'^^\Mh\'^^ ^ a'^a^^\Mh\'^^ . Notice that 
this is sufficient to prove the theorem since p > 35/2 and 25 < d together imply that 
25 < min{2p — 5, d} and p > 5. 

We start by letting S(i, j) ^ E(A^/„y(i)AP/„y(j)) for ah i,j £ 0„ and S ^ 
where Sa^s is the component-wise absolute value of S. The Hanson and Wright bound in 
[T7] gives 

(66) P{\Ql - EQl\ >e)< 2exp (^-^ A 

for all e > 0, where bi, 62 are positive constants not depending on n or S. Later in the proof 
we will show that 

'n^-'^P, 'dO> 5 -2p> -d; 

(67) l|S||^< ||S||2< <|n-<^logn, if5-2p = -d; 

n~'^, ii 5 -2p < -d. 

for all sufficiently large n. First, however, we show this is sufficient for the almost sure 



convergence result. Equations (66) and (67) immediately establishes that (j'^a^\Mh\^ 
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a^a^\Mh\^ since \Qp - EQl 



by Borel-Cantelli and Eu^a'' 



Mh\^ a'^a^\Mh\\ To 



see that a'^a'^^\Mh\'^^ a'^a'^^\Mh\'^^ notice that equations (66) and (67) imply 

P(n^|Q^-i^Q^|>e)<2exp 



(68) 



n2'5||S| 



for all sufficiently small e > and sufficiently large n. Therefore n^\Q'^ — EQ'p\ 

whenever 25 < min{2p - d,d}. Since Ea'^a'^^\Mh\'^^ a'^a'^^\Mh\'^^ , this is sufficient to 

establish a q > p > 6 so that a'^a^^h\'^^ ^ a^a^^lMhl"^^ . 

Now to finish the proof we need to establish (67). We start by noticing that for any p > 1 
there exists a constant c > such that 



|ai^'^)cov(y(s),y(t))| = l^if'^^jcT^exp 



laMx — a 



Myf]}\ 



for all s,t £ 0, such that s ^ t where 64 is a positive constant. Following the proofs of 
Lemma [6] we can then derive that there exists an > such that for any p > 1 

|S(i,j)|<n-'^|i-jf-'^ 

for all n > N, and i,j G such that |« — j| > |(p + l)h/n\. Moreover, 

\^{i,j)\<n-' 

for all n > and i,j G such that \i — j\ < \{p + l)h/n\. Now by direct analogs to 
Lemma [Tj Lemma [s] (by replacing 2u with 6) we have 



(69) 
(70) 



IISII2 < n-'^ + 65 n^-2P r^-^P+'^-^dr 

J 1/n 
Jl/n 



where 65, are positive constants. These equations hold when p > 1 and establish (67). 
This completes the proof. □ 
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